Image capturing apparatus

ABSTRACT

An image capturing apparatus includes an interval shooting section ( 51 ) that performs an interval shooting process, a lighten compositing section ( 54 ) that performs a lighten compositing process using images captured one by one by the interval shooting process, and a composite-image-in-progress displaying section ( 55 ) that, when a first operation is performed, causes a composite image in a first memory area, which is used as a compositing buffer for the lighten compositing process, to be displayed on an LCD monitor without causing the interval shooting process to be stopped.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. patentapplication Ser. No. 14/950,188, filed Nov. 24, 2015, which is acontinuation application of U.S. patent application Ser. No. 14/345,096,filed Mar. 14, 2014, now U.S. Pat. No. 9,225,912, issued Dec. 29, 2015,which is a National Stage of PCT/JP12/073970, filed Sep. 12, 2012, whichclaims the benefit of priority under 35 U.S.C. 119 from Japanese PatentApplication No. 2011-200828, filed in Japan on Sep. 14, 2011. The entirecontents of all of which are incorporated herein by reference.

TECHNICAL FIELD

The present invention relates to an image capturing apparatus thatcaptures an image by causing an optical image to be formed on an imagesensor.

BACKGROUND ART

In recent years, as digital cameras have become technologically advancedand widespread, digital cameras are used for various shooting purposes,and a number of new picture representation methods that were missing infilm-camera days are arising. Included among the methods is a method ofproducing a new picture utilizing a large number (generally over a fewhundred) of still images captured by performing interval shooting with adigital camera secured on a tripod. More specifically, lightencompositing, which is a type of compositing processes, is adopted onsome occasions to produce a photo in which the number of trails offireflies moving inside a picture display is increased or a photo inwhich trails of stars moving across a night sky due to diurnal motion ofthe earth are captured.

A lighten compositing process is performed according to the followingprocedure, for example. First, a first image, which is an image capturedfirst, of a large number of still images to be processed is written to acompositing memory area as an initial value. Luminance comparison ismade between a pixel of a second still image, which is an image capturednext to the first image, and the same pixel of the first still imagewritten to the compositing memory area, and a brighter one of the pixelsis rewritten to the compositing memory area. This operation is performedon every pixel, thereby causing a composite image of the first stillimage and the second still image to be stored in the compositing memoryarea. Thereafter, as for each of third and following still images, theoperation of making luminance comparison between a pixel of a stillimage to be processed and the same pixel of a composite image in thecompositing memory area and rewriting a brighter one of the pixels tothe compositing memory area is performed on every pixel, and this stepis repeatedly performed on every still image to be processed.

A composite image that looks as if the image was captured by longexposure is obtained by performing such a lighten compositing process asdescribed above using a large number of still images captured byinterval shooting with a digital camera. The lighten compositing processis generally executed by software installed in a personal computer(hereinafter, referred to as a “PC”). More specifically, a photographergenerally captures a large number of images by performing intervalshooting using a digital camera, transfers the images to the PC, andperforms the lighten compositing process using the software on the PC.

Described below are advantages and disadvantages of each of approachesthat are long exposure with a conventional film camera, normal longexposure with a digital camera, long exposure by stacking with a digitalcamera, and a lighten compositing process using a PC. The long exposureby stacking with a digital camera is, for example, long exposure thatutilizes the technique described in patent document 1.

(1) Long Exposure with Film Camera

<Advantage>

When long exposure is performed on a low-intensity subject, a formulathat doubling exposure duration makes a resultant photo brighter by adegree corresponding to 1 EV does not hold, and a film is less sensitiveto light (that is, a film generally has a characteristic called“reciprocity law failure”). Accordingly, long exposure on the order ofhours in a dark environment can be performed utilizing thischaracteristic (however, it should be noted that limitation to 1 to 2hours is imposed in Japan where night skies are bright, although thelimitation depends on an environment, when an ISO 100 film is used).This allows, by shooting a night sky, obtaining a photo in which trailsof stars are captured without making a low-intensity portion, whichcorresponds to background of the stars, too bright.

<Disadvantages>

Experience is required to determine exposure because of reciprocity lawfailure.

This approach is prone to color cast.

In an environment where subjects that differ largely in luminance aremixed, blown out highlights are undesirably produced in a brighterportion of a photo (therefore, an urban scene with stars trailing aslong as 1 hour cannot be captured with this approach).

The longer the light trails, the greater an f-stop number or the lower asensitivity of a film to be used becomes. Therefore, trails of darkstars (faint stars) are not captured (this is due to a principlegenerally called as limiting magnitude).

A user cannot view a composite image in progress.

A user cannot view a resultant image immediately after shooting.

(2) Normal Long Exposure with Digital Camera

<Advantages>

Because digital cameras are insusceptible to reciprocity law failureeven with a low-intensity subject, doubling exposure duration makes aresultant photo brighter by a degree corresponding to 1 EV.

This approach is suitable for a purpose of shooting photos in whichstars are still on a condition that a wide-angle lens is used, exposuretime is set to equal to or shorter than 20 seconds, and ISO sensitivityis set to a high sensitivity.

Color correction can be performed easily.

A user can view a resultant image immediately after shooting.

<Disadvantages>

Because digital cameras are insusceptible to reciprocity law failure,this approach is unsuitable at all for shooting on the order of hours(it is substantially impossible to perform such shooting with thisapproach because an entire photo becomes blown out highlights).

Random thermal noise, although it depends on a performance of an imagingdevice and a shooting environment, appears on a display when the digitalcamera does not include a cooling mechanism. This can be avoided bycooling; however, in that case, the digital camera also needs to includea mechanism for preventing condensation resulting from cooling, andtends to be large equipment.

It is difficult to reduce random noise with this approach.

A user cannot view a work in progress of exposure.

(3) Long Exposure by Stacking Using Digital Camera

<Advantages>

With this approach, reading from imaging devices and digitization areperformed at fixed intervals. Accordingly, shades of gray can be kepteven when long exposure by stacking is performed for a period longerthan that of normal long exposure of the digital camera.

Color correction can be performed easily.

A user can view a work in progress of exposure.

A user can view a resultant image immediately after shooting.

<Disadvantages>

Because digital cameras are insusceptible to reciprocity law failure,this approach is unsuitable at all for shooting on the order of hours(it is substantially impossible to perform such shooting with thisapproach because an entire photo becomes blown out highlights).

It is difficult to reduce random noise with this approach.

Continuity of time is broken because overall exposure time isinterrupted by time, although being short, necessary to read data fromthe sensors (this does not matter at a focal length on a wide-angle sidein star tail shooting; however, the longer the focal length is, the moregreatly this matters).

(4) Lighten Compositing Process Using PC

<Advantages>

Exposure can be determined easily because exposure that is determinedfor shooting of one image is nearly continuously used with thiscompositing method.

Color correction can be performed easily.

Even in an environment where subjects that differ largely in luminanceare mixed, this approach is less prone to blown out highlights (in acase of shooting an urban scene with star trails, duration of the trailscan be lengthened to desired time not later than morning unless ahappening such as incoming of light that is unpredictable at start ofshooting does not occur).

High-sensitivity shooting can be performed because exposure can bedetermined for shooting of one photo. Even trails of dark stars (faintstars) that cannot be captured with a film can be captured.

Thermal noise is negligible because exposure is performed not so much asto cause thermal noise to affect image quality. Therefore, the digitalcamera needs not to include a special cooling mechanism.

The greater the number of images to be stacked, the greater random noisecan be reduced in a degree incomparable to the other approaches.

This approach allows producing a composite image in which fireflies lookas if they are increased in number by intentionally breaking continuityof time. Continuity of time is intentionally broken also in star trailshooting on some occasions.

<Disadvantages>

Continuity of time is broken because overall exposure time isinterrupted by time, although being short, necessary to read data fromthe sensors (this does not matter at a focal length on a wide-angle sidein star tail shooting; however, the longer the focal length is, the moregreatly this matters).

A user cannot view a composite image in progress because the lightencompositing process is performed on a PC after shooting.

A user cannot view a resultant image immediately after shooting becausethe lighten compositing process is performed on a PC after shooting.

As described above, conventional long exposure with a digital camera((2) and (3) described above) is far inferior to long exposure with afilm camera ((1) described above). A main reason therefor is thatdigital cameras are insusceptible to reciprocal law failure.Furthermore, long exposure with a film camera also gives manyinconveniences.

In contrast, the lighten compositing process using a PC ((4) describedabove) is utilized as an approach that has not only a number ofadvantages of the other approaches ((1) to (3) described above) but alsogreatly excels the other approaches. However, this approach requiresthat a large number of images obtained by interval shooting with adigital camera are transferred to the PC to undergo the compositingprocess in the PC. Therefore, a photographer can neither envision afinished image during shooting nor can view a resultant photo at a photoshooting location immediately after completion of shooting.

PRIOR ART DOCUMENT Patent Document

Patent document 1: Japanese Patent Application Laid-open No. 2009-239600

DISCLOSURE OF INVENTION Problem to be Solved by the Invention

The present invention has been conceived in view of the abovecircumstances, and it is an object of the invention to provide an imagecapturing apparatus that implements a function convenient for a user byperforming a lighten compositing process while performing a shootingprocess.

Means for Solving Problem

To achieve the object, an image capturing apparatus according to thepresent invention includes an image sensor, a storage section, and adisplay section.

The image capturing apparatus comprises: an interval shooting sectionthat performs an interval shooting process that is a process thatrepeatedly performs exposure of and reading from the image sensor atpredetermined intervals to capture a plurality of images one by one; alighten compositing section that performs a lighten compositing processusing a first image and a second image of the plurality of imagescaptured by the interval shooting process one by one, the first imagebeing an initial image among the plurality of images, the second imagebeing captured subsequent to the first image, and stores a result of thelighten compositing process as a composite image in the storage section,and, as for each image of third and following images, the third imagebeing captured subsequent to the second image, performs the lightencompositing process using the each image and the composite image storedin the storage section and stores a result of the lighten compositingprocess as a new composite image in the storage section; and acomposite-image display section that, when a first operation isperformed, causes the display section to display the composite imagestored in the storage section without causing the interval shootingprocess to be stopped.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1A is a top view of a digital camera according to an embodiment ofthe present invention;

FIG. 1B is a front view of the digital camera according to theembodiment;

FIG. 1C is a rear view of the digital camera according to theembodiment:

FIG. 2 is a block diagram illustrating the configuration of a controlsystem of the digital camera according to the embodiment;

FIG. 3 is a diagram illustrating an example of a composite imageobtained by a lighten compositing process;

FIG. 4 is a diagram explaining initial setting screens for intervalcomposite shooting and screen transitions that occur on buttonoperations;

FIG. 5 is a functional block diagram illustrating a functionalconfiguration of a CPU block related to the interval composite shooting:

FIG. 6 is a flowchart illustrating a process procedure for an intervalshooting process;

FIG. 7 is a flowchart illustrating a process procedure for the lightencompositing process:

FIG. 8 is a flowchart illustrating a process procedure for ashooting-setting confirming process;

FIG. 9 is a flowchart illustrating a process procedure for aninterval-image-file output process:

FIG. 10 is a flowchart illustrating a process procedure for acomposite-image-in-progress displaying process;

FIG. 11 is a flowchart illustrating a process procedure for acompositing-buffer resetting process;

FIG. 12A is a timing diagram illustrating process states during a periodwhen the interval composite shooting is performed;

FIG. 12B is a timing diagram illustrating process states during a periodwhen the interval composite shooting is performed:

FIG. 12C is a timing diagram illustrating process states during a periodwhen the interval composite shooting is performed;

FIG. 12D is a timing diagram illustrating process states during a periodwhen the interval composite shooting is performed:

FIG. 13A is a timing diagram illustrating process states in a situationwhere a first operation is performed during a period when the intervalcomposite shooting is performed;

FIG. 13B is a timing diagram illustrating process states in a situationwhere a second operation is performed during a period when the intervalcomposite shooting is performed; and

FIG. 13C is a timing diagram illustrating process states in a situationwhere the second operation is performed during a period when theinterval composite shooting is performed.

BEST MODES FOR CARRYING OUT THE INVENTION

Exemplary embodiments of the present invention are described below withreference to the drawings.

The configuration of a digital camera according to an embodiment of thepresent invention is described first. FIGS. 1A to 1C are external viewsof the digital camera according to the present embodiment. FIG. 1A is atop view of the digital camera. FIG. 1B is a front view of the digitalcamera. FIG. 1C is a rear view of the digital camera.

The digital camera according to the present embodiment includes a subLCD 1, a release button 2, and a mode dial 3 on a top surface of thedigital camera as illustrated in FIG. 1A. The sub LCD 1 is a displaysection for displaying a maximum number of shots, for example. Therelease button 2 is a two-position button operable such that, forexample, when the release button 2 is pressed to a first position, anautomatic focusing (AF) operation is performed, while when the releasebutton 2 is pressed to a second position, shooting is performed. Themode dial 3 is to be operated for switching among various modes, such asa shooting mode for shooting (recording) images, a playback mode forplaying back recorded images, and a SETUP mode for configuring camerasettings.

The digital camera according to the present embodiment includes astrobe-light emitting section 4, a remote-control-light receivingsection 6 for receiving infrared signals from a remote control terminal(not shown), a lens barrel unit 7, and an optical viewfinder (frontside) 8 on a front surface of the digital camera as illustrated in FIG.1B. The digital camera according to the embodiment includes a memorycard slot into which a memory card 80, which will be described later, isto be inserted and a battery receptacle for accommodating a battery in aside surface of the digital camera. The memory card slot and the batteryreceptacle are sealed with a lid 9.

The digital camera according to the present embodiment also includes anautomatic focusing LED (AF LED) 10, a strobe LED 11, an LCD monitor 12,and an optical viewfinder (back side) 13 on a back surface of thedigital camera as illustrated in FIG. 1C. The AF LED 10 is an LED to belit when automatic focusing is activated. The strobe LED 11 is an LED tobe lit when strobe light is emitted. The LCD monitor 12 is a displaysection for displaying various setting screens and played-back imagesand for use as an electronic viewfinder during shooting.

Also arranged on the back surface of the digital camera according to thepresent embodiment are a ZOOM (WIDE) switch 14, a ZOOM (TELE) switch 15,a power supply switch 16, a playback switch 17, a self-timer/deleteswitch 18, a MENU/OK switch 19, a leftward/image-viewing switch 20, arightward switch 21, a downward/macro switch 22, an upward/strobe-lightswitch 23, and a DISPLAY switch 24. The ZOOM (WIDE) switch 14 isoperated when using wide-angle zooming. The ZOOM (TELE) switch 15 isoperated when using telephoto zooming. The self-timer/delete switch 18is operated when using a self timer and when deleting an image. TheMENU/OK switch 19 is operated when making a selection from a menu andwhen confirming a selected option. The leftward/image-viewing switch 20is operated when moving a cursor on the LCD monitor 12 to the left andwhen viewing a shot image on the LCD monitor 12. The rightward switch 21is operated to moving a cursor on the LCD monitor 12 to the right andthe like. The downward/macro switch 22 is operated when moving a cursoron the LCD monitor 12 down and when shooting in a macro mode. Theupward/strobe-light switch 23 is operated when moving a cursor on theLCD monitor 12 up and when switching a strobe mode. The DISPLAY switch24 is operated when switching a display on the LCD monitor 12.

FIG. 2 is a block diagram illustrating the configuration of a controlsystem of the digital camera according to the present embodiment. Thedigital camera according to the present embodiment includes a CCD 101,an F/E (front-end)-IC 102, and a digital camera processor (hereinafter,abbreviated as “processor”) 104. The CCD 101 performs photoelectricconversion of light entered via the lens barrel unit 7 to output anelectrical signal. The F/E-IC 102 pre-processes the analog electricalsignal output from the CCD 101 to output a digital signal. The processor104 processes the digital signal fed from the F/E-IC 102 to execute andcontrol various operations of the digital camera.

The lens barrel unit 7 includes a zoom optical system 71 for capturingan optical image of a subject, a focus optical system 72, an aperturestop unit 73, a mechanical shutter unit 74, and a motor driver 75. Thezoom optical system 71 includes a zoom lens 71 a and a zoom motor 71 b.The focus optical system 72 includes a focus lens 72 a and a focus motor72 b. The aperture stop unit 73 includes an aperture stop 73 a and anaperture stop motor 73 b. The mechanical shutter unit 74 includes amechanical shutter 74 a and a mechanical shutter motor 74 b. The motordriver 75 drives the motors. Driving of the motor driver 75 iscontrolled according to a driving instruction fed from a CPU block 1043,which will be described later, in the processor 104.

The CCD 101 is an image sensor that receives the light entered via thelens barrel unit 7 and performs photoelectric conversion of an opticalimage of the light to output image data that corresponds to the opticalimage. Meanwhile, the digital camera according to the present embodimentuses the CCD 101 as the image sensor. Alternatively, other image sensor,such as a CMOS image sensor, may be used in lieu of the CCD 101. When aCMOS image sensor is used as the image sensor, the configuration of thecontrol system is to be somewhat changed; however, descriptionthereabout is omitted.

The F/E-IC 102 includes a CDS 1021, an AGC 1022, an A/D converter 1023,and a TG (timing generator) 1024. The CDS 1021 performs correlativedouble sampling to remove image noise. The AGC 1022 performs gaincontrol. The A/D converter 1023 converts an analog signal into a digitalsignal. The TG 1024 generates drive timing signals for the CCD 101, theCDS 1021, the AGC 1022, and the A/D 1023 based on a verticalsynchronizing signal (VD signal) and a horizontal synchronizing signal(HD signal) fed from a first CCD-signal processing block 1041, whichwill be described later, in the processor 104. The CPU block 1043, whichwill be described later, in the processor 104 controls operations of thecomponents of the F/E-IC 102.

The processor 104 includes the first CCD-signal processing block 1041, asecond CCD-signal processing block 1042, the CPU block 1043, a localSRAM 1044, a USB block 1045, a serial block 1046, a JPEG CODEC block1047, a RESIZE block 1048, a TV-signal display block 1049, and amemory-card controller block 10410. These blocks in the processor 104are connected to one another over a bus line.

The first CCD-signal processing block 1041 performs white balancecompensation and gamma correction on the image data input to theprocessor 104 from the CCD 101 via the F/E-IC 102, and also feeds the VDsignal and the HD signal described above for use in timing control ofthe image data to the TG 1024. The second CCD-signal processing block1042 performs filtering on the input image data to convert the imagedata into luminance data and color-difference data.

The CPU block 1043 controls operations of components of the digitalcamera according to the present embodiment. More specifically, the CPUblock 1043 controls an audio recording operation performed by an audiorecording circuit 1151. Audio is converted by a microphone 1153 intoaudio signals, which are then amplified by a microphone amplifier 1152.The audio recording circuit 1151 records the audio signals according toan instruction fed from the CPU block 1043. The CPU block 1043 alsocontrols an audio reproducing operation performed by an audioreproducing circuit 1161. The audio reproducing circuit 1161 reproducesaudio signals recorded in an appropriate memory to input the audiosignals to an audio amplifier 1162, causing a speaker 1163 to provideaudio according to an instruction fed from the CPU block 1043. The CPUblock 1043 also controls operations of a strobe light circuit 114,thereby causing the strobe-light emitting section 4 to emit illuminationlight. In addition, the CPU block 1043 performs various processes toimplement the function (hereinafter, referred to as “interval compositeshooting”), which is a function characteristic of the presentembodiment, of performing the lighten compositing process whileperforming an interval shooting process. These are described in detaillater.

The CPU block 1043 is connected to a sub CPU 109 arranged external tothe processor 104. The sub CPU 109 controls display on the sub LCD 1 viaan LCD driver 111. The sub CPU 109 is also connected to the AF LED 10,the strobe LED 11, the remote-control-light receiving section 6, abuzzer 113, and an operation key unit 90. The operation key unit 90includes various switches which are the release button 2, the mode dial3, the ZOOM (WIDE) switch 14, the ZOOM (TELE) switch 15, the powersupply switch 16, the playback switch 17, the self-timer/delete switch18, the MENU/OK switch 19, the leftward/image-viewing switch 20, therightward switch 21, the downward/macro switch 22, theupward/strobe-light switch 23, and the DISPLAY switch 24 describedabove. The sub CPU 109 utilizes output signals of the operation key unit90 and the remote-control-light receiving section 6 as user operationinformation to control operations of the AF LED 10, the strobe LED 11,and the buzzer 113 according to the user operation information. The subCPU 109 also transmits the user operation information to the CPU block1043 in the processor 104.

The local SRAM 1044 is a memory for temporarily storing data necessaryto perform control and the like. The USB block 1045 carries out USBcommunications with external equipment, such as a computer terminal,connected to a USB connector 122. The serial block 1046 carries outserial communications via a serial driver circuit 1231 with externalequipment, such as a computer terminal, connected to an RS-232Cconnector 1232.

The JPEG CODEC block 1047 compresses data pertaining to a shot image ina JPEG format and decompresses data pertaining to a recorded imagecompressed in the JPEG format. The RESIZE block 1048 increases/reducesan image data size by interpolation.

The TV-signal display block 1049 converts image data into video signalsto be displayed on an external display device such as the LCD monitor 12or a TV. The TV-signal display block 1049 is connected to an LCD driver117 so that an image is displayed on the LCD monitor 12 driven by theLCD driver 117. The TV-signal display block 1049 is also connected to avideo AMP 118 so that, when a video jack 119 is connected to externaldisplay equipment such as a TV, an image is displayed on the externaldisplay equipment.

The memory card controller block 10410 is connected to a memory cardslot 121 and controls the memory card 80, a general-purpose PCMCIA, andthe like inserted into the memory card slot 121.

An SDRAM 103, a RAM 107, a ROM 108, and a built-in memory 120 arearranged external to the processor 104. These are connected to theprocessor 104 over the bus line.

The SDRAM 103 is a memory for temporarily stores image data when theprocessor 104 performs image processing on the image data. Examples ofthe image data to be stored in the SDRAM 103 include “RAW-RGB imagedata” fed from the CCD 101 via the F/E-IC 102 and undergone whitebalance compensation and gamma correction performed by the firstCCD-signal processing block 1041, “YUV image data” undergoneluminance-data conversion and color-difference-data conversion performedby the second CCD-signal processing block 1042, and “JPEG image data”compressed in the JPEG format by the JPEG CODEC block 1047. The SDRAM103 includes a first memory area and a second memory area to be utilizedin the interval composite shooting, which will be described later.

The ROM 108 stores a control program described in program code decodableby the CPU block 1043 and parameters for use in control. Theseparameters may alternatively be stored in the built-in memory 120. Whenthe power supply to the digital camera is turned on, the control programis loaded into a main memory (not shown). The CPU block 1043 controlsoperations of the components according to the control program andtemporarily stores data and the like necessary for control in the RAM107 and the local SRAM 1044 in the processor 104. In the presentembodiment, a program for performing the interval composite shooting,which will be described later, is also stored in the ROM 108. In thedescription of the present embodiment, it is assumed that the intervalcomposite shooting is implemented by the program. Alternatively, aconfiguration in which a portion of the process. e.g., the lightencompositing process, is performed using special-purpose hardware such asan ASIC (Application Specific Integrated Circuit) or an FPGA(Field-Programmable Gate Array) can be employed.

The built-in memory 120 is a memory for recording data pertaining to ashot image in a case where the memory card 80 is not inserted into thememory card slot 121. The RAM 107 is a memory to be utilized as aworking area by the CPU block 1043 when executing various programs.

The interval composite shooting that is characteristic of the digitalcamera according to the present embodiment is described below. Theinterval composite shooting is a function of performing the lightencompositing process while performing the interval shooting process asdescribed above.

The interval shooting process is a process that repeatedly performsexposure of and reading (reading image data) from the CCD 101 which isthe image sensor at predetermined intervals to capture a plurality ofimages one by one.

The lighten compositing process is a process that produces a compositeimage using a plurality of images by comparing luminance of a pixel ofone image with luminance of a pixel at the same position of anotherimage, and selects a brighter one of the pixels on a per-pixel-by-pixelbasis. As described above, the lighten compositing process is initiallyperformed using the first image and the second image, and a result ofthis process is stored as a composite image. Thereafter, as for eachimage of the third and following images, the process is performed usingthe each image and the composite image which is the result of thepreceding process, and an image obtained as a result of this process isstored as new composite image. A final composite image is obtained byperforming the above process on every image to be processed.

The digital camera according to the present embodiment performs thelighten compositing process utilizing two memory areas in the SDRAM 103.Each of the two memory areas is a frame memory) for holding datacorresponding to one image. Hereinafter, one of the two memory areas isreferred to as the first memory area, and the other is referred to asthe second memory area. The first memory area is a memory to be used asa compositing buffer for the lighten compositing process and stores acomposite image which is a result of the lighten compositing process.The second memory area is a memory to be used as a buffer for anot-yet-composited still image. Images captured by the interval shootingprocess are stored one by one in the second memory area.

FIG. 3 is a diagram illustrating an example of the composite imageobtained by the lighten compositing process. A group of images to beprocessed is illustrated on the left of FIG. 3. A composite imageobtained by performing the lighten compositing process on the imagegroup is illustrated on the right of FIG. 3. Each of the pixels in thecomposite image obtained by the lighten compositing process is a pixelhaving a maximum luminance value among corresponding pixels of the imagegroup. Accordingly, as is the example illustrated in FIG. 3, there canbe obtained a composite image that looks as if it was obtained by longexposure in which star trails streak due to diurnal motion of the earth,and in which star-absent night-sky portions and a bright scene coexistwithout blown out highlights. Meanwhile, for the sake of simplicity, thenumber of images in the image group illustrated on the left of FIG. 3 isreduced, however, the composite image illustrated on the right of FIG. 3is produced using over 300 images in practice.

In the interval composite shooting, images captured one by one by theinterval composite shooting make up the image group on which the lightencompositing process is to be performed. Each time an image is capturedby the interval composite shooting, the lighten compositing process isperformed using the captured image. Put another way, the intervalcomposite shooting and the lighten compositing process are performedconcurrently. This allows implementing various functions, which will bedescribed later, that are convenient for a user.

The digital camera according to the present embodiment includes anoperation mode for performing the interval composite shooting(hereinafter, referred to as “interval composite shooting mode”) as oneof shooting modes. The interval composite shooting mode can be selectedby operating the mode dial 3, for example. First, initial settings forthe interval composite shooting are described with reference to FIG. 4.FIG. 4 is a diagram explaining initial setting screens for the intervalcomposite shooting and screen transitions that occur on buttonoperations.

The initial setting screen for the interval composite shootingillustrated in FIG. 4 appears on the LCD monitor 12 when a user operatesthe power supply switch 16 to turn on the power supply to the digitalcamera, selects the interval composite shooting mode by operating themode dial 3 or the like, configures various settings related to shootingas desired, and thereafter presses the MENU/OK switch 19. The user canconfigure various settings related to the interval composite shooting onthis initial setting screen by selecting a menu item by operating theleftward/image-viewing switch 20 or the rightward switch 21 andselecting an option of each menu item by operating the downward/macroswitch 22 or the upward/strobe-light switch 23. Hereinafter, theleftward/image-viewing switch 20, the rightward switch 21, thedownward/macro switch 22, and the upward/strobe-light switch 23 arereferred to as the leftward button, the rightward button, the downwardbutton, and the upward button, respectively, for brevity.

FIG. 4(a) illustrates an example screen of a state that allows setting“digits representing hours” of a shooting interval (i.e., length of timebetween exposure start and issuance of an instruction for startingexposure for next shooting; this time length is hereinafter referred toas “interval time”) of each image in the interval shooting process. Byoperating the upward button or the downward button in the stateillustrated in FIG. 4(a), the digits can be changed. Operating therightward button causes the screen illustrated in FIG. 4(a) to transitto the screen illustrated in FIG. 4(b). Operating the leftward buttoncauses the screen illustrated in FIG. 4(a) to transit to the screenillustrated in FIG. 4(e).

FIG. 4(b) illustrates an example screen of a state that allows setting“digits representing minutes” of the interval time. By operating theupward button or the downward button in the state illustrated in FIG.4(b), the digits can be changed. Operating the rightward button causesthe screen illustrated in FIG. 4(b) to transit to the screen illustratedin FIG. 4(c). Operating the leftward button causes the screenillustrated in FIG. 4(b) to transit to the screen illustrated in FIG.4(a).

FIG. 4(c) illustrates an example screen of a state that allows setting“digits representing seconds” of the interval time. By operating theupward button or the downward button in the state illustrated in FIG.4(c), the digits can be changed. Operating the rightward button causesthe screen illustrated in FIG. 4(c) to transit to the screen illustratedin FIG. 4(d). Operating the leftward button causes the screenillustrated in FIG. 4(c) to transit to the screen illustrated in FIG.4(b).

FIG. 4(d) illustrates an example screen of a state that allows settingas to whether to save data held in the first memory area, that is, thecomposite image that has been produced, when the first memory area usedas the compositing buffer for the lighten compositing process is resetin response to reset of the interval composite shooting during theinterval composite shooting. By operating the upward button or thedownward button in this state illustrated in FIG. 4(d), one of “SAVEPRE-RESET COMPOSITE IMAGE” and “SAVE NONE” options can be selected for a“FILE OUTPUT SETTING FOR COMPOSITING-RESET OCCASION” menu item.Operating the rightward button causes the screen illustrated in FIG.4(d) to transit to the screen illustrated in FIG. 4(e). Operating theleftward button causes the screen illustrated in FIG. 4(d) to transit tothe screen illustrated in FIG. 4(c). “SAVE PRE-RESET COMPOSITE IMAGE” isan option for outputting a composite image having been produced untiljust before the lighten compositing process is reset in an image fileform and storing the image file in the memory card 80 or the like. “SAVENONE” is an option for not storing the composite image having beenproduced until just before the lighten compositing process is reset.

FIG. 4(e) illustrates an example screen of a state that allows settingas to whether to save images for use in the interval composite shooting.By operating the upward button or the downward button in this stateillustrated in FIG. 4(e), one of “NORMALLY SAVE STILL IMAGE”, “SAVECOMPOSITE STILL IMAGE”. “NORMALLY SAVE MOVIE”, “SAVE COMPOSITE MOVIE”,and “SAVE NONE” options is selected for an “INTERVAL-IMAGE-FILE OUTPUTSETTING” menu item. Operating the rightward button causes the screenillustrated in FIG. 4(e) to transit to the screen illustrated in FIG.4(a). Operating the leftward button causes the screen illustrated inFIG. 4(e) to transit to the screen illustrated in FIG. 4(d). “NORMALLYSAVE STILL IMAGE” is an option for, each time an image is captured inthe interval shooting process, outputting the not-yet-composited image(still image) in an image file form and storing the image file in thememory card 80 or the like. “SAVE COMPOSITE STILL IMAGE” is an optionfor, each time an image is captured by the interval shooting process,outputting a composite image (still image) in progress as of this pointin time in an image file form and storing the image file in the memorycard 80 or the like. “NORMALLY SAVE MOVIE” is an option for, each timean image is captured by the interval shooting process, generating amovie file that contains the not-yet-composited image (still image) asone frame of a movie and storing the file in the memory card 80 or thelike. “SAVE COMPOSITE MOVIE” is an option for, each time an image iscaptured by the interval shooting process, generating a movie file thatcontains a composite image (still image) in progress as of this point intime as one frame of a movie and storing the file in the memory card 80or the like. “SAVE NONE” is an option for not storing images for use inthe interval composite shooting (note that when the “FILE OUTPUT SETTINGFOR COMPOSITING-RESET OCCASION” menu item is set to the “SAVE PRE-RESETCOMPOSITE IMAGE” option, a composite image produced just before reset isstored).

Setting of each menu item can be confirmed by pressing the MENU/OKswitch 19 regardless of which one of the initial setting screensillustrated in FIG. 4 is displayed on the LCD monitor 12. Thereafter,when the release button 2 is pressed to the second position(all-the-way-down pressing operation), the interval composite shootingis started.

FIG. 5 is a functional block diagram illustrating a functionalconfiguration of the CPU block 1043 related to the interval compositeshooting. As described above, the processes involved in the intervalcomposite shooting are performed by a program, for example. The CPUblock 1043 includes an interval shooting section 51, a shooting-settingconfirming section 52, an interval-image-file output section 53, alighten compositing section 54, a composite-image-in-progress displayingsection 55, and a compositing-buffer resetting section 56 as functionalcomponents that execute the processes involved in the interval compositeshooting.

The interval shooting section 51 executes the “interval shootingprocess”. A concrete process procedure for the “interval shootingprocess” to be executed by the interval shooting section 51 is describedlater with reference to FIG. 6.

The shooting-setting confirming section 52 executes a “shooting-settingconfirming process”. A concrete process procedure for the“shooting-setting confirming process” to be executed by theshooting-setting confirming section 52 is described later with referenceto FIG. 8.

The interval-image-file output section 53 executes an“interval-image-file output process”. A concrete process procedure forthe “interval-image-file output process” to be executed by theinterval-image-file output section 53 is described later with referenceto FIG. 9.

The lighten compositing section 54 executes the “lighten compositingprocess”. A concrete process procedure for the “lighten compositingprocess” to be executed by the lighten compositing section 54 isdescribed later with reference to FIG. 7.

The composite-image-in-progress displaying section 55 executes a“composite-image-in-progress displaying process”. A concrete processprocedure for the “composite-image-in-progress displaying process” to beexecuted by the composite-image-in-progress displaying section 55 isdescribed later with reference to FIG. 10.

The compositing-buffer resetting section 56 executes a“compositing-buffer resetting process”. A concrete process procedure forthe “compositing-buffer resetting process” to be executed by thecompositing-buffer resetting section 56 is described later withreference to FIG. 11.

Among the processes to be executed by the CPU block 1043 in the intervalcomposite shooting mode of the digital camera according to the presentembodiment, the “shooting-setting confirming process” and the“interval-image-file output process” are executed sequentially in such amanner as in a function call from the “interval shooting process”. Theother processes which are the “lighten compositing process”, the“composite-image-in-progress displaying process”, and the“compositing-buffer resetting process” are concurrently executed bymultitasking.

Interval composite shooting operations are described below withreference to the flowcharts illustrated in FIGS. 6 to 11.

FIG. 6 is a flowchart illustrating the process procedure for the“interval shooting process” to be performed by the interval shootingsection 51 of the CPU block 1043. The control flow illustrated in FIG. 6is a main routine of the interval composite shooting, and controlstiming for starting the “lighten compositing process” while performingthe “interval shooting process” and the like.

First, a process of clearing a compositing-process-in-progress flag isperformed at Step S101. A process of resetting anumber-of-stacked-images counter to zero is performed at Step S102. Thecompositing-process-in-progress flag is a flag indicating whether the“lighten compositing process” is during execution. Thenumber-of-stacked-images counter is a counter indicating a position ofan image currently composited by the “lighten compositing process” in asequential order of images. These processes at Step S101 and Step S102are processes for resetting variables in the program.

Subsequently, the “shooting-setting confirming process” is performed atStep S103. The “shooting-setting confirming process” is a process thatperforms an AF (automatic focusing) process and an AE (automaticexposure control) process to determine a focus position and exposurebefore a series of the interval shooting processes is performed. Asdescribed above, the “shooting-setting confirming process” is calledfrom the “interval shooting process” in such a manner as in a functioncall and executed as a subroutine. The process procedure for the“shooting-setting confirming process” is described later.

Subsequently, a process of starting interval time measurement isperformed at Step S104. This process is a process that activates abuilt-in timer to measure interval time.

Subsequently, an exposure process is performed at Step S105. Theexposure process is a process that performs exposure of the CCD 101which is the image sensor. Even when exposure is completed, data is notread from the CCD 101 yet in this process.

Subsequently, determination as to whether thecompositing-process-in-progress flag is set is made at Step S106. Thisprocess is a process that determines whether compositing of an imagecaptured by preceding shooting in the series of interval shootingprocesses is completed by referring to variables in the program. Whenthe compositing of the image captured by the preceding shooting is notcompleted yet and the compositing-process-in-progress flag is set (Yesat Step S106), the control flow is put on wait until the compositingprocess is completed. When the compositing of the image captured by thepreceding shooting is completed and the compositing-process-in-progressflag is cleared (No at Step S106), the control flow proceeds to a nextstep.

Subsequently, a process of reading data from the CCD 101 which is theimage sensor is performed at Step S107. This process is a process thatreads an image obtained by exposure of the CCD 101 from the CCD 101 andstores the image in the second memory area.

Subsequently, determination as to whether the initial setting describedabove is made so as to store images for use in the interval compositeshooting is made at Step S108. When the setting is made so as to storeimages for use in the interval composite shooting (Yes at Step S108),the “interval-image-file output process” is performed. When the settingis made so as not to store images for use in the interval compositeshooting (No at Step S108), the “interval-image-file output process” isskipped.

Subsequently, the “interval-image-file output process” is performed atStep S109. The “interval-image-file output process” is a process thatstores an image for use in the interval composite shooting based on theinitial setting made by a user. As described above, the“interval-image-file output process” is called from the “intervalshooting process” in such a manner as in a function call and executed asa subroutine. The process procedure for the “interval-image-file outputprocess” is described later.

Subsequently, a process of setting the compositing-process-in-progressflag is performed at Step S110. This process is a process that sets avariable in the program.

Subsequently, a process of instructing to start the “lighten compositingprocess” is performed at Step S111. This process is a process thatstarts the “lighten compositing process” that is executed concurrentlywith the “interval shooting process”. The process procedure for the“lighten compositing process” is described later.

Subsequently, determination as to whether an operation that terminatesthe interval shooting process is performed is made at Step S112.Examples of the operation that terminates the interval shooting processincludes the operation (all-the-way-down pressing operation) of pressingthe release button 2 to the second position. When such an operation thatterminates the interval shooting process is performed (Yes at StepS112), the interval shooting process is terminated. When such anoperation that terminates the interval shooting process is not performed(No at Step S112), the control flow proceeds to a next step.

Subsequently, determination as to whether the interval time has elapsedis made at Step S113. This process is a process that determines whethertime to shoot a next image has come based on the interval time specifiedby a user in the initial setting described above. When the interval timehas not elapsed yet and therefore the time to shoot a next image has notcome yet (No at Step S113), the control flow is put on wait until theinterval time elapses. When the interval time has elapsed and the timeto shoot the next image has come (Yes at Step S113), the control flowreturns to Step S104 to start interval time measurement and shoot thenext image.

FIG. 7 is a flowchart illustrating the process procedure for the“lighten compositing process” to be performed by the lighten compositingsection 54 of the CPU block 1043. This control flow illustrated in FIG.7 is executed concurrently with the control flow illustrated in FIG. 6by multitasking. Meanwhile, description about the lighten compositingprocess is omitted because it has already been described above indetail.

First, determination as to whether the number-of-stacked-images counteris zero is made at Step S201. This process is a process that determineswhether to reset the first memory area for use as the compositingbuffer. The number-of-stacked-images counter is set to zero at the firstshooting in the “interval shooting process” or at the first shootingafter the “compositing-buffer resetting process”, which will bedescribed later, has been performed. When the number-of-stacked-imagescounter is zero, that is, when shooting to be performed is the firstshooting in the “interval shooting process” or the first shooting afterthe “compositing-buffer resetting process” has been performed (Yes atStep S201), the control flow proceeds to Step S202. On the other hand,when the number-of-stacked-images counter is not zero, that is, when theshooting to be performed is neither the first shooting in the “intervalshooting process” nor the first shooting after the “compositing-bufferresetting process” has been performed (No at Step S201), the controlflow proceeds to Step S203.

A process of copying the image stored in the second memory area, thatis, the image captured by the “interval shooting process”, to the firstmemory area is performed at Step S202.

At Step S203, the lighten compositing process is performed using theimage stored in the second memory area, that is, the image captured bythe “interval shooting process”, and a composite image stored in thefirst memory area, that is, the composite image produced by a precedinglighten compositing process, and a new composite image which is a resultof the lighten compositing process is stored in the second memory area.

Subsequently, a process of incrementing the number-of-stacked-imagescounter by one is performed at Step S204.

Subsequently, a process of clearing the compositing-process-in-progressflag is performed at Step S205.

FIG. 8 is a flowchart illustrating the process procedure for the“shooting-setting confirming process” to be performed by theshooting-setting confirming section 52 of the CPU block 1043. Thecontrol flow illustrated in FIG. 8 is a subroutine called from thecontrol flow illustrated in FIG. 6.

First, determination as to whether the AF mode is on is made at StepS301. The AF mode is a mode for specifying whether to perform the AF(automatic focusing) process during shooting. When the AF mode is on,the AF process is to be performed, while when the AF mode is off,focusing is to be manually performed. When the AF mode is on (Yes atStep S301), the control flow proceeds to Step S302 where the AF processis performed. On the other hand, when the AF mode is off (No at StepS301), the control flow skips the AF process at Step S302 and proceedsto Step S303.

Subsequently, determination as to whether the AE mode is on is made atStep S303. The AE mode is a mode for specifying whether to perform theAE (automatic exposure control) process during shooting. When the AEmode is on, the AE process is to be performed, while when the AE mode isoff, exposure control is to be manually performed. When the AE mode ison (Yes at Step S303), the control flow proceeds to Step S304 where theAE process is performed. On the other hand, when the AE mode is off (Noat Step S303), processing is terminated.

The “shooting-setting confirming process” of the control flowillustrated in FIG. 8 is performed when capturing the first image in the“interval shooting process”. In a case where the AF mode is on, the AFprocess is performed when the first image is captured, and a result ofthe AF process is held. Then, each of the second and following images iscaptured using the result of the AF process obtained when the firstimage is captured. In a case where the AE mode is on, the AE process isperformed when the first image is captured, and a result of the AEprocess is held. Then, each of the second and following images iscaptured using the result of the AE process obtained when the firstimage is captured.

FIG. 9 is a flowchart illustrating the process procedure for the“interval-image-file output process” to be performed by theinterval-image-file output section 53 of the CPU block 1043. The controlflow illustrated in FIG. 9 is a subroutine called from the control flowillustrated in FIG. 6.

First, a process of obtaining information about what option is set forthe “INTERVAL-IMAGE-FILE OUTPUT SETTING” menu item (see FIG. 4) at theinitial setting described above is performed at Step S401. When theoption set for the “INTERVAL-IMAGE-FILE OUTPUT SETTING” menu item is“NORMALLY SAVE STILL IMAGE”, the control flow proceeds to Step S402.When the option is “SAVE COMPOSITE STILL IMAGE”, the control flowproceeds to Step S403. When the option is “NORMALLY SAVE MOVIE”, thecontrol flow proceeds to Step S404. When the option is “SAVE COMPOSITEMOVIE”, the control flow proceeds to Step S405. When the option is “SAVENONE”, processing is terminated.

A process of outputting the data stored in the second memory area, thatis, the not-yet-composited image captured by the “interval shootingprocess”, in a still image file form and storing the file in the memorycard 80 or the like is performed at Step S402.

A process of outputting the data stored in the first memory area, thatis, the composite image in progress of the “lighten compositing process”as of this point in time, in a still image file form and storing thefile in the memory card 80 or the like is performed at Step S403.

A process of producing a movie file that contains the data stored in thesecond memory area, that is, the not-yet-composited image captured bythe “interval shooting process”, as one frame of a movie and storing thefile in the memory card 80 or the like is performed at Step S404. Eachtime a new image is captured by the “interval shooting process”, theimage is added to this movie file as one frame of the movie.

A process of producing a movie file that contains the data stored in thefirst memory area, that is, the composite image in progress of the“lighten compositing process” as of this point in time, as one frame ofa movie and storing the file in the memory card 80 or the like isperformed at Step S405. Each time a new image is captured by the“interval shooting process”, the composite image in progress at thepoint in time is added to this movie file as one frame of the movie.

FIG. 10 is a flowchart illustrating the process procedure for the“composite-image-in-progress displaying process” to be performed by thecomposite-image-in-progress displaying section 55 of the CPU block 1043.The control flow illustrated in FIG. 10 is started when a predeterminedfirst operation which is, for example, an operation of pressing therelease button 2 to the first position (halfway-down pressing operation)is performed during the interval composite shooting operations. Thecontrol flow is executed concurrently with the control flow illustratedin FIG. 6 or the control flow illustrated in FIG. 7 by multitasking.

First, determination as to whether the compositing-process-in-progressflag is set is made at Step S501. This process is a process that causesthe control flow not to proceed to a next step until thecompositing-process-in-progress flag is cleared. Over a period when thecompositing-process-in-progress flag is set (Yes at Step S501), pollingis performed. When the compositing-process-in-progress flag is cleared(No at Step S501), the control flow proceeds to Step S502.

Subsequently, determination as to whether the number-of-stacked-imagescounter is zero is made at Step S502. This process is a process thatcauses the control flow not to proceed to a next step until thenumber-of-stacked-images counter becomes a value other than zero (untilan image to be displayed is generated). Over a period when thenumber-of-stacked-images counter is zero (Yes at Step S502), polling isperformed. When the number-of-stacked-images counter becomes a valueother than zero (No at Step S502), the control flow proceeds to StepS503.

Subsequently, a process of displaying the data stored in the firstmemory area, that is, the composite image in progress of the “lightencompositing process” as of this point in time, and the value of thenumber-of-stacked-images counter, that is, the number of still imagesused to produce the composite image, on the LCD monitor 12 is performedat Step S503.

Subsequently, determination as to whether display time has elapsed ismade at Step S504. The display time may be a predetermined fixed value:or, alternatively, may be set by a user. Whether the display time haselapsed cane be determined, for example, based on a value of a built-intimer that is activated when the displaying at Step S503 is started.Over a period when the display time has not elapsed yet (No at StepS504), the display on the LCD monitor 12 is maintained (as-is status).When the display time has elapsed (Yes at Step S504), the control flowproceeds to Step S505.

A process of clearing the display on the LCD monitor 12 is performed atStep S505.

FIG. 11 is a flowchart illustrating the process procedure for the“compositing-buffer resetting process” to be performed by thecompositing-buffer resetting section 56 of the CPU block 1043. Thecontrol flow illustrated in FIG. 11 is started when a predeterminedsecond operation which is, for example, an operation of pressing theself-timer/delete switch 18 is performed during the interval compositeshooting operations. The control flow is executed concurrently with thecontrol flow illustrated in FIG. 6 or the control flow illustrated inFIG. 7 by multitasking.

First, determination as to whether the compositing-process-in-progressflag is set is made at Step S601. This process is a process that causesthe control flow not to proceed to a next step until thecompositing-process-in-progress flag is cleared. Over a period when thecompositing-process-in-progress flag is set (Yes at Step S601), pollingis performed. When the compositing-process-in-progress flag is cleared(No at Step S601), the control flow proceeds to Step S602.

A process of resetting the number-of-stacked-images counter to zero isperformed at Step S602. This process causes the control flow illustratedin FIG. 7 to branch to a Yes route at Step S201. As a result, the“lighten compositing process” is reset.

Subsequently, a process of obtaining information about what option isset for the “FILE OUTPUT SETTING FOR COMPOSITING-RESET OCCASION” menuitem (see FIG. 4) at the initial setting described above is performed atStep S603. When the option set for the “FILE OUTPUT SETTING FORCOMPOSITING-RESET OCCASION” menu item is “SAVE PRE-RESET COMPOSITEIMAGE”, the control flow proceeds to Step S604, while when the option is“SAVE NONE”, processing is terminated.

A process of outputting the data stored in the first memory area, thatis, the composite image immediately preceding reset of the “lightencompositing process”, in an image file form and storing the file in thememory card 80 or the like is performed at Step S604.

FIGS. 12A to 12D are timing diagrams each illustrating process statesduring a period when the interval composite shooting is performed. Inthe present embodiment, it is assumed that the “lighten compositingprocess” is performed by software (program) and therefore requiresprocessing time of approximately one second. However, if the “lightencompositing process” is performed using special-purpose hardware, theprocessing time can be reduced. The timing diagrams illustrated in FIGS.12A to 12D indicate how process states during a period when the intervalcomposite shooting is performed varies depending on setting of intervaltime and setting of exposure time in a condition where the processingtime required by the “lighten compositing process” described above issubstantially uniform.

The second memory area is a memory in which images captured by theinterval shooting process are to be stored one by one as describedabove. In each period indicated by “WRITING” in the drawings, data fromthe CCD 101 which is the image sensor is written to the second memoryarea. Each period indicated by “OUTPUT ENABLED” in the drawings is aperiod during which a change in value does not occur during memory readand therefore memory read or file output can be performed.

The first memory area is a memory in which a composite image which is aresult of the “lighten compositing process” is to be stored as describedabove. The period indicated by “COPYING” or “COMPOSITING PROCESS INPROGRESS” is a period during which stored data in the memory is possiblychanged by the “lighten compositing process”. Each period indicated by“OUTPUT ENABLED” in the drawings is a period during which a change invalue does not occur during memory read and therefore memory read orfile output can be performed.

FIG. 12A is a timing diagram for a case where the exposure time isrelatively long and a set value of the interval time is still longerthan the exposure time. This is a timing diagram for nighttime shootingsettings suitable for such a photo in which lights of fireflies areoverlaid and to which long intervals between shootings does not matter.

FIG. 12B is a timing diagram for a case where the exposure time isrelatively long and a set value of the interval time is shorter than aminimum shooting-available cycle. This is a timing diagram for nighttimeshooting settings suitable for such a photo that captures star trailsand to be shot with minimum shooting intervals.

FIG. 12C is a timing diagram for a case where the exposure time isrelatively short and a set value of the interval time is relatively longas in the case of FIG. 12A. This is suitable for daytime shooting toobtain a photo that does not require time continuity.

FIG. 12D is a timing diagram for a case where the exposure time isrelatively short and a set value of the interval time is shorter thanthe minimum shooting-available cycle. This is suitable for daytimeshooting to record a phenomenon that can be captured without timecontinuity but changes more quickly than that of the example illustratedin FIG. 12C in one image.

FIGS. 13A to 13C are timing diagram each illustrating process states ina situation where the first operation (e.g., halfway-down pressing therelease button 2) or the second operation (e.g., pressing theself-timer/delete switch 18) is performed during a period when theinterval composite shooting is performed.

FIG. 13A is a timing diagram of a situation where the first operation(e.g., halfway-down pressing the release button 2) is performed during aperiod when the interval composite shooting is performed and the“image-in-progress-of-compositing displaying process” illustrated inFIG. 10 is performed without stopping the “interval shooting process”.Referring to FIG. 13A, when the first operation is performed when thestatus of the first memory area is “OUTPUT ENABLED”, the data stored inthe first memory area, that is, a composite image in progress of the“lighten compositing process” as of this point in time, is immediatelydisplayed on the LCD monitor 12. Referring to FIG. 13A, when the firstoperation is performed when the status of the first memory area is“COMPOSITING PROCESS IN PROGRESS”, the displaying operation is put onwait until the compositing process is completed.

FIG. 13B is a timing diagram of a situation where the second operation(e.g., pressing the self-timer/delete switch 18) is performed when thestatus of the first memory area is “OUTPUT ENABLED” and the“compositing-buffer resetting process” illustrated in FIG. 11 isperformed without stopping the “interval shooting process”. When thesecond operation is performed in this situation, thenumber-of-stacked-images counter is reset immediately. However,referring to FIG. 13B, even when the first operation is performed in aperiod when copying of the first image after reset of thenumber-of-composited-images counter is not completed yet, the displayingoperation is put on wait.

FIG. 13C is a timing diagram of a situation where the second operation(e.g., pressing the self-timer/delete switch 18) is performed when thestatus of the first memory area is “COMPOSITING PROCESS IN PROGRESS” andthe “compositing-buffer resetting process” illustrated in FIG. 11 isperformed without stopping the “interval shooting process”. When thesecond operation is performed in this situation, a process of resettingthe number-of-stacked-images counter is put on wait until the “lightencompositing process” ends. Furthermore, referring to FIG. 13C, even whenthe first operation is performed in a period when copying of the firstimage after reset the number-of-composited-images counter is notcompleted yet, the displaying operation is put on wait.

As described above by way of specific examples, the digital cameraaccording to the present embodiment has the interval composite shootingfunction that performs the lighten compositing process while performingthe interval shooting process. Accordingly, the digital camera canperform such operations as described below.

First, a composite image in progress can be displayed on the LCD monitor12 while continuing the interval shooting process. Accordingly, aphotographer can envision a finished image during shooting.

Furthermore, the lighten compositing process can be reset whilecontinuing the interval shooting process. Furthermore, images obtainedin lighten compositing processes performed until then can be stored.Accordingly, even when unnecessary light (light of a vehicle or a lighttrail of an airplane that unexpectedly enters a field of view) entersthe field of view during shooting, the following can be achieved whilecontinuing the shooting at a shooting site. That is, it becomes possibleto obtain data from which a movie is to be produced later in which timecontinuity is maintained and such light is capitalized, and also toperform re-compositing to produce still images with light trails.

Furthermore, it is possible to obtain data, from which a movie is to beproduced later, by performing shooting for as long as period possibleand also to produce a plurality of still images containing light trailsof a desired length that are visually checked by a user from the samedata.

It is possible to perform selective use such that when free space of astorage medium such as the built-in memory 120 or the memory card 80 ofthe digital camera is small, only a result of compositing is recorded,while when the free space is sufficiently large, all data obtained bythe interval shooting is recorded.

By performing shooting of a kind for capturing star trails, originaldata that allows easy production of a movie in which trails of starsgradually extend can be obtained. Power users are apt to perform fineadjustment on still images before producing movie data therefrom. Thedigital camera can satisfy such demands.

Even a user who is weak at postprocessing using a PC can produce a movie(what is called as a time-lapse movie) made up of frames captured overan extended period of time and appearing to be thinned to a short-timemovie using only the digital camera.

Even a user who is weak at postprocessing using a PC can performshooting of a kind for capturing star trails to produce a movie in whichtrails of stars gradually extend using only the digital camera.

A photographer can view not only a composite image stored in the firstmemory area but also grasp how many images are stacked to obtain thecomposite image while performing shooting easily.

It is also possible to avoid such a problem that during the series ofinterval compositing shooting operations, the AF function and the AEfunction react to a subject that has unexpectedly temporarily enteredthe field of view and undesirably change control values of only a partof a series of shot images, thereby undesirably making still images or amovie obtained by the lighten compositing process unnatural.

As described above, the interval composite shooting function that ischaracteristic of the digital camera according to the present embodimentis implemented by the program to be executed by the CPU block 1043, forexample. The program for implementing the interval composite shootingfunction is provided as being installed in advance in the ROM 108 of thedigital camera, for example. The program for implementing the intervalcomposite shooting function may be provided as a file of an installableformat or an executable format recorded in a computer-readable recordingmedium such as a CD-ROM, a flexible disk (FD), a CD-R, or a digitalversatile disk (DVD). The program for implementing the intervalcomposite shooting function may be configured to be stored in a computerconnected to a network such as the Internet and provided by downloadingvia the network. The program for implementing the interval compositeshooting function may be configured to be provided or distributed via anetwork such as the Internet.

The program for implementing the interval composite shooting function inthe digital camera according to the present embodiment has a modulestructure that includes processing functions of the interval shootingsection 51, the shooting-setting confirming section 52, theinterval-image-file output section 53, the lighten compositing section54, the composite-image-in-progress displaying section 55, and thecompositing-buffer resetting section 56 described above. From aviewpoint of actual hardware, the CPU block 1043 reads out the programfrom the ROM 108 and executes the program to load the processingfunctions on a main memory (e.g., the SDRAM 103) so that the processingfunctions are set up on the main memory.

Specific embodiments of the present invention have been described above;however, the present invention is not limited to the embodimentsdescribed above, and can be modified in various manners withoutdeparting from the scope of the invention. In other words, theconfigurations and operations of the digital camera described above aremerely specific examples, and can be modified in various mannersdepending on use and object.

Although the invention has been described with respect to specificembodiments for a complete and clear disclosure, the appended claims arenot to be thus limited but are to be construed as embodying allmodifications and alternative constructions that may occur to oneskilled in the art that fairly fall within the basic teaching herein setforth.

The invention claimed is:
 1. An image capturing apparatus, comprising:circuitry configured to perform an interval shooting process that is aprocess that repeatedly performs exposure of and reading from an imagesensor at predetermined intervals to capture a plurality of images oneby one, and perform a lighten compositing process using a first imageand a second image of the plurality of images captured by the intervalshooting process one by one, the first image being an initial imageamong the plurality of images, the second image being capturedsubsequent to the first image, and store a result of the lightencompositing process as a composite image in a memory, and, as for eachof a third and following images, the third image being capturedsubsequent to the second image, perform the lighten compositing processusing the each image and the composite image stored in the memory, andstore a result of the lighten compositing process as a new compositeimage in the memory, wherein when the circuitry is set to perform anyone of an automatic focusing function and an automatic exposure controlfunction, the circuitry captures the first image with the automaticfocusing or the automatic exposure control function, and captures thesecond image and the following images using a result of the automaticfocusing or the automatic exposure control function performed forcapturing the first image.
 2. The image capturing apparatus according toclaim 1, wherein the circuitry is further configured to, each time animage is captured by the interval shooting process, output the capturedimage in an image file form.
 3. The image capturing apparatus accordingto claim 1, wherein the circuitry is further configured to, each time animage is captured by the interval shooting process, output a compositeimage as of a corresponding point in time in an image file form.
 4. Theimage capturing apparatus according to claim 1, wherein the circuitry isfurther configured to, each time an image is captured by the intervalshooting process, generate a movie file that contains the captured imageas one frame of a movie.
 5. The image capturing apparatus according toclaim 1, wherein the circuitry is further configured to, each time animage is captured by the interval shooting process, generate a moviefile that contains a composite image as of a corresponding point in timeas one frame of a movie.
 6. The image capturing apparatus according toclaim 1, further comprising: a release button configured to be pressedto a first position and a second position, wherein the circuitry isfurther configured to, when a first operation is performed, cause adisplay to display the composite image stored in the memory withoutcausing the interval shooting process to be stopped, the first operationbeing an operation of pressing the release button to the first position.7. The image capturing apparatus according to claim 1, wherein thecircuitry is further configured to, each time an image is captured bythe interval shooting process, output the captured image in an imagefile form, in response to receiving a first selection that is displayedvia a display, output a composite image as of a corresponding point intime in an image file form, in response to receiving a second selectionthat is displayed via the display, generate a movie file that containsthe captured image as one frame of a movie, in response to receiving athird selection that is displayed via the display, and generate a moviefile that contains a composite image as of a corresponding point in timeas one frame of a movie, in response to receiving a fourth selectionthat is displayed via the display.
 8. An image capturing method,comprising: performing, using circuitry, an interval shooting processthat is a process that repeatedly performs exposure of and reading froman image sensor of an image capturing apparatus at predeterminedintervals to capture a plurality of images one by one; performing, usingthe circuitry, a lighten compositing process using a first image and asecond image of the plurality of images captured by the intervalshooting process one by one, the first image being an initial imageamong the plurality of images, the second image being capturedsubsequent to the first image, and storing a result of the lightencompositing process as a composite image in a memory of the imagecapturing apparatus, and, as for each of a third and following images,the third image being captured subsequent to the second image,performing the lighten compositing process using the each image and thecomposite image stored in the memory, and storing a result of thelighten compositing process as a new composite image in the memory; andwhen any one of an automatic focusing function and an automatic exposurecontrol function is set to be performed, capturing the first image withthe automatic focusing or the automatic exposure control function, andcapturing the second image and the following images using a result ofthe automatic focusing or the automatic exposure control functionperformed for capturing the first image.
 9. The image capturing methodaccording to claim 8, further comprising: each time an image is capturedby the interval shooting process, outputting the captured image in animage file form.
 10. The image capturing method according to claim 8,further comprising: each time an image is captured by the intervalshooting process, outputting a composite image as of a correspondingpoint in time in an image file form.
 11. The image capturing methodaccording to claim 8, further comprising: each time an image is capturedby the interval shooting process, generating a movie file that containsthe captured image as one frame of a movie.
 12. The image capturingmethod according to claim 8, further comprising: each time an image iscaptured by the interval shooting process, generating a movie file thatcontains a composite image as of a corresponding point in time as oneframe of a movie.
 13. The image capturing method according to claim 8,further comprising: when a first operation is performed, causing adisplay of the image capturing apparatus to display the composite imagestored in the memory without causing the interval shooting process to bestopped, the first operation being an operation of pressing a releasebutton to a first position.
 14. The image capturing method according toclaim 8, further comprising: each time an image is captured by theinterval shooting process, outputting the captured image in an imagefile form, in response to receiving a first selection that is displayedvia a display of the image capturing apparatus; outputting a compositeimage as of a corresponding point in time in an image file form, inresponse to receiving a second selection that is displayed via thedisplay; generating a movie file that contains the captured image as oneframe of a movie, in response to receiving a third selection that isdisplayed via the display; and generating a movie file that contains acomposite image as of a corresponding point in time as one frame of amovie, in response to receiving a fourth selection that is displayed viathe display.
 15. A non-transitory computer-readable storage mediumincluding computer executable instructions, wherein the instructions,when executed by a computer, cause the computer to perform a method, themethod comprising: performing an interval shooting process that is aprocess that repeatedly performs exposure of and reading from an imagesensor at predetermined intervals to capture a plurality of images oneby one; performing a lighten compositing process using a first image anda second image of the plurality of images captured by the intervalshooting process one by one, the first image being an initial imageamong the plurality of images, the second image being capturedsubsequent to the first image, and storing a result of the lightencompositing process as a composite image in a memory, and, as for eachof a third and following images, the third image being capturedsubsequent to the second image, performing the lighten compositingprocess using the each image and the composite image stored in thememory, and storing a result of the lighten compositing process as a newcomposite image in the memory; and when any one of an automatic focusingfunction and an automatic exposure control function is set to beperformed, capturing the first image with the automatic focusing or theautomatic exposure control function, and capturing the second image andthe following images using a result of the automatic focusing or theautomatic exposure control function performed for capturing the firstimage.